Modelling recorded crime: a full search for cointegrated models 
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A modelgenerator is developed that searches for cointegrated models among a potentially large 
group of candidate models. The generator employs the first step of the Engle-Granger procedure and 
orders cointegrated models according to the information criterions AIC and BIG. Assisted by the 
generator, a cointegrated relation is established between recorded violent crime in the Netherlands, 
the number of males aged 15-25 years (split into Western and non- Western background) and deflated 
consumption. In-sample forecasts reveal that the cointegrated model outperforms the best short-run 
models. 



I. INTRODUCTION 



The statistical relation between recorded crime and 
economic and demographic variables, such as unemploy- 
ment and the number of young males, is not only of fun- 
damental importance P, [1, 0] , but becomes increasingly 
important in forecasting tools for policy and planning 
decisions jj, |5i] . As recorded crime and its predictor vari- 
ables are generally integrated of order one, two kinds of 
models exist. There are short-run models specified in first 
differences and cointegrated models specified in levels. In 
a short-run model, crime has a strong stochastic dynamic 
of its own, eventually drifting away uncontrollably from 
the relation with its predictors. Conversely, in a cointe- 
grated model, crime fluctuates with constant variability 
around the relation with its predictors, thereby preserv- 
ing its importance in the long run. As a consequence, 
cointegrated models are to be favored over short-run 
models when making long term forecasts. Theoretically, 
given a set of predictor variables, one cannot argue con- 
clusively whether a cointegrated model applies. Empir- 
ically, however, a time series analysis indicates whether 
a cointegrated model is supported by the data or not 
^'^^ example, no cointegration was found between 
crime and unemployment in England and Wales 0] , while 
a cointegrated relation was established between robbery 
rate and divorce rate in the United States 0]. 

The objective of this work is to go beyond a time series 
analysis for a fixed set of predictor variables. Rather, we 
consider all subsets of a set of potential predictor vari- 
ables and search for cointegrated models. The kind of 
crime under investigation is violent crime in the Nether- 
lands, composed of robbery, assault, homicide, rape and 
extortion. The set of potential predictor variables con- 
sists of unemployment, the number of males aged 15-25 
years of Western background, the number of males aged 
15-25 years of non-Western background, the number of 
divorces and deflated consumption. A manual inspec- 
tion of all subsets is not feasible because the number of 
subsets, and thereby the number of candidate models. 



grows exponentially with the number of potential predic- 
tor variables. Even with five potential predictor variables 
and allowing for a potential error correction parameter, 
a constant or a constant and a trend, nearly two hun- 
dred candidate models exist. To investigate these mod- 
els, we developed a modelgenerator that automatically 
builds and estimates them and subsequently checks for 
cointegration. The cointegration check consists of the 
first step of the Engle-Granger (EG) procedure Q. The 
generator discards models that are not cointegrated and 
then estimates the cointegrated models using NLS re- 
gression. Finally, the generator orders the cointegrated 
models using the information criterions AIC jSi] and BIC 



II. MODELSTRUCTURE AND PRELIMINARY 
DATA ANALYSIS 

A necessary condition for the existence of a cointe- 
grated relation is that all variables involved are inte- 
grated of the same non-vanishing order. ADF tests [l3| 
indicate that recorded violent crime and its potential pre- 
dictor variables do not reject one or more null hypotheses 
of a unit root up to the 0.10 level. These tests were per- 
formed on annual data ranging from 1978 to 2006 and 
the detailed results are listed in Table H] We also per- 
formed KPSS tests that reverse the null hypothesis 
(a unit root) and the alternative hypothesis (stationar- 
ity) of the ADF tests. The KPSS results are included 
in Table IH The probabilities of X2 having a unit root 
and of X2 being stationary are all rather small (see Ta- 
ble U for the symbolic notation of the variables). Further 
analysis reveals that X2 is more likely to be integrated of 
order two than of order one. However, based on the joint 
picture emerging from Table [H we conclude that all vari- 
ables (including X2) are integrated of order one. Having 
met the necessary condition, the following cointegrated 
model may exist 
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^PiXu+Tlt, where Vt ^ j 



(j)C 
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< 1. 
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Here, t denotes discrete time measured in years, 5' is a 
non-empty subset of the integer set Sq = {1,2,3,4,5}, 
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j3i is the coefficient connecting Xt to y and e is Gaussian 
white noise. The operator C is the backshift operator 
retarding a variable with one year and the autoregressive 
noise 77 is stationary and causal with correlation length 
— l/ln|0| measured in years. Model ([T]) may be aug- 
mented with a constant c or a constant and a trend c+5t. 



TABLE I: Results of ADF tests and KPSS tests on recorded 
violent crime and its potential predictor variables. The lag 
length of the ADF tests is selected with BIC. The numbers in 
the ADF columns are the probabilities of the variable having 
a unit root. The subcolumns '0', 'C and 'CT' correspond to 
a random walk around, respectively, zero, a constant and a 
constant and a trend. The probabilities are based on finite- 
sample distributions of the DF statistic il2| of Ref. p^ . The 
KPSS tests are performed with the Bartlett kernel and the 
data- based Newey-West bandwidth selection procedure [l^ . 
The numbers in the KPSS subcolumns 'C and 'CT' are the 
probabilities of the variable being stationary around, respec- 
tively, a constant and a constant and a trend. These prob- 
abilities are based on the asymptotic test statistics of Ref. 
H. 



variable 


ADF 


KPSS 


symbol 


description 





C 


CT 


C 


CT 


y 


recorded violent crime 


1.00 


0.98 


0.65 


< 0.05 


< 0.05 


Xi 


unemployment (number 
of persons aged 15-65 years 
looking for a job) 


0.63 


0.02 


0.00 


> 0.10 


< 0.10 


X2 


number of males 
aged 15-25 years 
of Western background 


0.13 


0.01 


0.00 


< 0.05 


« 0.10 


X3 


number of males 
aged 15-25 years 
of non- Western background 


0.99 


1.00 


0.01 


< 0.05 


< 0.10 


X4^ 


number of divorces 


0.83 


0.07 


0.39 


< 0.10 


> 0.10 


X5 


deflated consumption 


1.00 


1.00 


0.06 


< 0.05 


< 0.05 



correlogram did not have any significant lag structure, 
indicating that Pi is a scalar. Now we turn to the tem- 
poraneous relations between y and the remaining predic- 
tor variables. The variables X2 and 3:3 are based on the 
age distribution of crime 13, iBl- Their impact on y is 
instantaneous, but may also have a lagged component 
based on the following argument. A relatively violent 
(non-violent) group of individuals that is within the age 
cohort at time t, but outside the cohort at time t' > t, 
may influence yt' such that it is larger (smaller) than ex- 
pected based on X2t' and x^t' ■ That is, /32 and may be 
transfer functions, and when they are, probably with a 
non-vanishing number of roots in their denominators to 
capture the long term correlations. We again employ the 
Box- Jenkins methodology and find that P2 and P3 are 
scalars. Finally, X4 is indicative of strain in society 
and X5 is important from both the motivational (/Js < 0) 
and the opportunity perspective (/Js > 0). Both variables 
are assumed to impact y instantaneously, an assumption 
confirmed by a Box- Jenkins analysis. 

All variables are left untransformed. Taking the loga- 
ritm of y and the Xi carries the additive model ([T]) over 
into a multiplicative one. The transformed model with 
S = {j} takes the form yt = x^^e^*, such that y depends 
non-linearly on Xj (if Pj ^ 1) and the variability of y de- 
pends on Xj . Traces of these signatures were not found 
in scatter plots of y and the Xi. Also, in the Box- Jenkins 
analyses, all variables became stationary (up to the 0.10 
level of the KPSS test with a constant) after differencing 
without first taking the logaritm. This also holds for de- 
flated consumption, which, in contrast to consumption, 
does not need to be transformed prior to differencing. 



III. THE MODELGENERATOR 



The relation between the Xi and y in model |T]) is in- 
stantaneous. This seems too restrictive as more com- 
plicated temporaneous relations are plausible. For ex- 
ample, in modelling the unemployment-crime relation, 
lagged unemployment has been argued to influence cur- 
rent crime numbers from a motivational perspective . 
Indeed, such an effect has been found in a short-run 
model of violent crime (robbery excluded) Mathe- 
matically, this corresponds to Pi being a transfer function 
rather than a coefficient. The transfer function would 
be a polynomial in C corresponding to the substitution 
Pi Pio + PiiC- Here, the coefficient Piq < corre- 
sponds to the instantaneous effect of xi on y argued from 
the opportunity perspective. The coefficient Pn > cor- 
responds to the lagged influence of xi on y argued from 
the motivational perspective [2^. To find out whether 
our historical data contain evidence of such a tempora- 
neous relation, we employ the Box- Jenkins methodology 
[l^ . This consists of stationarizing xi and y by differ- 
encing, prewhitening Xi with an ARMA filter, applying 
the filter to the stationarized y and inspecting the cor- 
relogram of the prewhitened xi and the filtered y. The 



The modelgenerator builds all models based on the 
(2^ — 1) non-empty subsets of Sq. Possibly augmented 
with a constant or a constant and a trend, there are 
3(2^ — 1) candidate models. In addition, the genera- 
tor considers models with restriction rj = e (this corre- 
sponds to (j) — 0) and models without this restriction. 
This brings the total number of candidate models to 
6(2^ — 1) = 186. The generator checks each model for 
cointegration and then orders the cointegrated models 
according to information criterions. These two stages of 
operation are described below. 



A. Checking models 

On multiplying both sides of Eq. ^ by (1 — (j)C) and 
subtracting (1 — 0)yt_i, the model takes error correction 
(EC) form 



Ayt = ^AAxt + (0~l) 
ies 



Vt-i - ^PiXif^t-i) 



+et. (2) 
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Here, A = 1 — £ is the difference operator and the term 
with square brackets is the EC term. The regression 
equation ([2]) is non-Hnear in its parameters fii (and pos- 
sibly a constant or a constant and a trend) and error 
correction parameter |2^]. The first step of the EG 
procedure consists of estimating the coefficients (3i (and 
possibly a constant or a constant and a trend) with the 
restriction </) = 0. Due to the restriction, the regression 
is linear and OLS is used. If a DF test on the residuals 
fails to reject the null hypothesis of a unit root up to the 
0.05 level according to the asymptotic test statistics of 
Ref. [l^, the generator considers the two corresponding 
candidate models (the one with = in the first place 
and the one without this restriction) not cointegrated and 
discards them. 

In the second step of the EG procedure, the term in 
square brackets in Eq. ([2]) is replaced by the lagged resid- 
uals of the first step and the resulting equation is esti- 
mated by OLS. As computation time is not really an issue 
with a moderate number of candidate models, the gen- 
erator does not employ the second EG step and rather 
solves Eq. ((2]) directly using a Marquardt NLS algorithm. 
The algorithm is assisted by analytic derivatives of the 
squared residuals to (p and executed with a coefficient 
accuracy of 1 • 10^^ and a maximum number of 5 • lO'^ it- 
erations. After estimating the parameters, the generator 
inspects the residuals and discards all models that reject 
the null hypothesis of no serial correlation up to the 0.20 
level of the Breusch-Godfrey (BG) LM test fT9l,'2^. The 
BG LM test is performed with two lags and pre-sample 
residuals are set to zero. 



B. Ordering models 

The information criterions AIC and BIG take the form 

N\nn 



AIC = InSSR 



2N 

, BIC = lnSSR 

n 



(3) 



Here, SSR is the sum of squared residuals of the NLS 
estimation, N is the total number of estimated parame- 
ters and n is the sample size. Models with smaller AIC - 
an estimator of the cross-entropy between the unknown 
operating model and the candidate model, averaged over 
the operating model - are favored over models with larger 
AIC. The same holds for BIG which is related to the pos- 
terior probability of a model as ^ exp(— BIG/2). In finite 
samples, AIC underestimates the averaged cross-entropy 
and favors models that are too complex [21!]. If n > 8 
such that Inn > 2, BIG has a larger penalty term than 
AIC and favors simpler models. Which of the two crite- 
rions is more appropriate for finite n > 8 cannot be said 
beforehand and the generator employs both. 



IV. RESULTS 

Out of the 186 candidate models, the generator pro- 
duces 15 cointegrated models. The top-6 of best models 



according to AIC happens to coincide with that according 
to BIG in the sense that they contain the same models, 
but with a different ordering. These 6 models, as well as 
the corresponding evidence ratio's (ER's), are listed in 
Table HIl ER is related to AIC and BIG as, respectively, 
exp(-(AIG - AICmi„)/2) and exp(-(BIG - BICmin)/2). 
Here, AlCmin (BlCmin) denotes the smallest AIC (BIG) 
out of the cointegrated models. For BIG, ER measures 
the ratio of a posterior probability and the highest poste- 
rior probability. The results of Table [H] indicate that all 
6 models contain the number of non- Western males 
and deflated consumption x^. In contrast, the number 
of divorces x^ does not appear in any of the cointegrated 
models. 

In an additional run of the generator, we used {x2+x^) 
rather than X2 and ^3. The reason for this is the follow- 
ing. Suppose the unknown operating model contains the 
number of males aged 15-25 years without distinguishing 
between Western and non- Western background. Then, 
models containing X2 and 2:3 unnecessarily require esti- 
mation of both and (3^, while in fact (32 = (3^. Out 
of the 6 ■ 2'^ = 48 candidate models containing {x2 +2^3), 
two are found cointegrated. Both models have a larger 
AIC and BIG than models I- VI and leave the results of 
Tabic |TT] unaffected. 



TABLE II: Schematic listing of cointegrated models. The 
variables Xi represent the potential predictor variables as 
listed in Table |l] The symbol 'X' indicates inclusion of the 
corresponding predictor variable (or constant c, trend t or er- 
ror correction parameter cf)). The columns 'ER AIC and 'ER 
BIC hold, respectively, the ER's according to AIC and BIC. 
While the models are ordered according to BIC, the num- 
bers in brackets in the column 'ER AIC denote their order 
according to AIC. The numbers in the column 'BG LM' are 
the probabilities of the residuals having no serial correlation 
according to the BG LM test. The column 'EG DF' holds the 
DF statistics of the OLS residuals of the first step of the EG 
procedure and the numbers in brackets are the corresponding 
asymptotic test statistics at the 0.05 level of Ref. IT3|. 



model 


ER 
AIC 


ER 
BIC 


BG 
LM 


EG DF 


number 


c 


t 


xi 




X3 




X5 




I 


X 








X 




X 




0.99 (3) 


1.00 


0.38 


-3.92 (-3.74) 


II 


X 






X 


X 




X 




1.00 (2) 


0.99 


0.37 


-4.41 (-4.10) 


III 


X 


X 


X 




X 




X 




1.00 (1) 


0.97 


0.35 


-4.67 (-4.43) 


IV 


X 








X 




X 


X 


0.96 (6) 


0.95 


0.84 


-3.92 (-3.74) 


V 


X 


X 




X 


X 




X 




0.98 (4) 


0.94 


0.35 


-4.48 (-4.43) 


VI 


X 




X 


X 


X 




X 




0.97 (5) 


0.94 


0.37 


-4.49 (-4.41) 



To investigate the cointegration structure of models I- 
VI, we consider the VEG (vector error correction) models 



Azt 



a[-f + St + P^zt^i] + a±S' + fif 



(a) 
(b) 



(4) 



Here, z is the 5-dimensional columnvector 
{y,Xi,X2,X3,Xci)'^ and 'T' denotes the transpose of 
a matrix or vector. The matrices a and (3 are 5 x r 
matrices, where r < 4 is the cointegration rank. The 
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5-dimensional columnvector /i is Gaussian white noise 
with 5x5 covariance matrix Q. The r-dimensional 
columnvector 7 holds constants within the EC terms 
a [7 + /3'^zt_i] and a[-y + 6t + P'^zt-i] . Similarly, the 
r-dimensional columnvector S holds prefactors of the 
trend t inside the EC term a [7 + 5< + f3^zt~i] . The 
(5 — r)-dimensional columnvector 6' corresponds to 
trends in the columnspace of the 5 x (5 — r) matrix 
a± satisfying a^a± — 0. The difference between the 
VEC model (g]) and the EC model dH) is that the latter 
describes the dynamics of y only, while the former 
describes the joint dynamics of y and {xi,X2,X3,X5). 
The correspondence between the VEC model and the 
EC model is, that, conditioned on (xi, a;2, 2:3, 0:5), the 
stochastic process of y implied by the VEC model takes 
the form of the EC model ^25] . 

We first consider models I, H, IV, VI and perform a 
Johansen cointegration test [3] to find r, a, P and 7 of 
VEC model (a) without trends. Up to the 0.05 level of 
Ref. 22], the trace test indicates r — 3 (LR — 0.065) 
and the maximum eigenvalue test indicates r = 4 (LR = 
0.022). We accept r — 4. This means that there is only 
one common non-stationary signal and the 4 linear com- 
binations corresponding to the elements of f]"^ z are such 
that this signal is cancelled. To see if this agrees with 
an EC model, we try to find coefhcients such that 
Y.LlS.i{0I,l^){z'^,cV equals the EC term of the EC 
model. Here, /3i denotes the i-th column of p. Indeed, 
for each EC model, a set of coefficients exists within 
error bounds of a standard deviation above and below the 
estimated parameters. Now we turn to models III, V and 
find r, a, /?, 7 and 5 of VEC model (b) with trends. Up 
to the 0.05 level, both the trace test and the maximum 
eigenvalue test indicate r = 3, with, respectively, LR = 
0.079 and LR — 0.063. In this case, we search for co- 
efficients £,i such that tiil^J iln Si){z'^, c, t)'^ equals 
the EC term of an EC model. It turns out that, for both 
models, sets of coefficients {^i} do not exist within error 
bounds. In other words, models III, V are not consistent 
with the VEC model at the 0.05 level and we discard 
them. 

The estimated parameters of models I, II, IV, VI are 
listed in Table IIIII The estimated parameter of xi in 
model VI is insignificant. The same holds for the EC 
parameter (p in model IV. As it does not hold X2, model 

I is less plausible than model II. We conclude that model 

II is the best cointegrated model. 



V. A COMPARISON WITH SHORT-RUN 
MODELS 

In Sec. lIVi only 15 cointegrated models were found out 
of 186 candidate models specified in levels. This means 
that for many subsets S, the proper model specification 
is in first differences rather than in levels. We therefore 



TABLE III; Estimated parameters and t-ratio's (in brackets) 
of models I, II, IV, VI of Table HH 



model 


number 


c- 10^ 


xi ■ 10"^ 


X2 ■ 10-2 


X3 ■ 10-2 


X5 " 




T 

1 


oy 
(-10.2) 






(5.3) 


U.O i 

(8.0) 




II 


-89 
(-4.6) 




1.5 
(1.6) 


28.3 
(4.7) 


0.44 
(7.0) 




IV 


-57 
(-7.2) 






33.2 
(3.9) 


0.35 
(5.4) 


0.26 
(1.2) 


VI 


-95 
(-4.0) 


3.2 
(0.5) 


1.5 
(1.6) 


23.7 
(2.1) 


0.47 
(4.8) 





"expressed in millions of euros deflated with respect to tfie year 
2000 



consider the short-run model 

Ayt =^/3,Aa;»t-Het. (5) 

Model ([5]) may be augmented with a constant and when 
it is, S may the empty set. The generator is used to find 
the best out of the 2^ — 1 = 63 short-run models. (The 
cointegration check is switched off and the models are 
estimated with OLS.) The generator finds 51 models with 
a BG LM probability of no serial correlation exceeding 
0.20. The top-5 models according to BIG are listed in 
Table lTVl Models I and IV are equal up to an insignificant 
constant in model IV. Model II holds only Aa;3 and is 
considered too simple. The coefficient of Axi in model 
V is insignificant and we conclude that models I and III 
are the best short-run models. 

In an additional run of the generator, we used A (0:2 -|- 
xa) rather than Aa;2 and Aa;3. Out of the 16 candidate 
models containing A (0:2 +2:3), the generator selects 14 
models. All these models have a larger AIC and BIG than 
models TV and leave the results of Table IIVI unaffected. 

The predictive power of short-run models I and III 
is compared to that of cointegrated model II by in- 
sample forecasts. The outcome of the comparison is not 
known beforehand: x^ may be a good predictor of y and 
the short-run models can outperform the cointegrated 
model when making short term forecasts. We make a 
long (short) term forecast, estimating the models using 
data from 1978 up to 1995 (2000) and forecasting them 
from 1996 (2001) to 2006. The forecasts are based on a 
Monte Carlo simulation of 10^ repetitions (including co- 
efficient uncertainty) and consist of mean forecasts and 
error bounds. The results for short-run model I and the 
cointegrated model are indicated in Fig. [TJ Panel (a) 
holds the long term forecasts and indicates that the coin- 
tegrated model outperforms the short-run model in the 
sense that its mean predictions are closer to the realiza- 
tions and that its error bounds are smaller. In panel (b), 
holding the short term forecasts, the mean forecasts of 
the models are very similar, but the error bounds of the 
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TABLE IV: Estimated parameters and t-ratio's (in brackets) 
of the top-5 short-run models according to BIG. The columns 
'ER AIC and 'ER BIG' hold, respectively, the ER's according 
to AIG and BIG. The numbers in brackets in the column 'ER 
AIC' denote the ranking according to AIC. The column 'BG 
LM' holds the probabilities of the residuals having no serial 
correlation according to the BG LM test. 



model 


ER 


ER 


BG 


number 


c 




Ax-2 


AX3 






AIC 


BIG 


LM 


I 








0.36 
(2.9) 


0.46 
(2.0) 


0.29 
(2.7) 


1.00 (1) 


1.00 


0.39 


II 








0.62 
(6.2) 






0.91 (18) 


0.95 


1.00 


III 




-17 
(-2.0) 




0.65 
(6.7) 


0.48 
(2.0) 




0.95 (5) 


0.95 


1.00 


IV 


-464 
(-0.4) 






0.41 
(2.3) 


0.48 
(2.0) 


0.32 
(2.3) 


0.97 (2) 


0.95 


0.25 


V 




-3.2 
(-0.3) 




0.39 
(2.2) 


0.47 
(2.0) 


0.26 
(1.7) 


0.97 (3) 


0.94 


0.39 



short-run model are larger. The forecasts of short-run 
model III are similar to that of short-run model I. In 
panel (a) , short-run model III would produce mean fore- 
casts a bit worse than that of short-run model I. In panel 
(b), it would produce mean forecasts a bit closer to the 
realizations than that of short-run model I and the coin- 
tegrated model. The error bounds of short-run model III 
are comparable to that of short-run model I. 



are the number of males aged 15-25 years of non- Western 
background and the number of divorces. Based on a 
plausibility argument and the statistical significance of 
estimated parameters, two short-run models are selected 
from the ordered list. In addition to the key predictors, 
one of the short-run models holds deflated consumption 
and the other unemployment. In-sample forecasts reveal 
that the cointegrated model outperforms the two short- 
run models in both mean predictions (long term) and 
error bounds (long term and short term). 
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VI. CONCLUSIONS 

We have developed a modelgenerator that searches for 
cointegrated models among candidate models specified 
in levels. The generator employs the first step of the EG 
procedure to decide whether a model is cointegrated or 
not. Subsequently, it estimates the cointegrated models 
with NLS regression and checks the residuals with the 
BG LM test. Finally, it orders models according to both 
AIC and BIG. The generator is applied to recorded vio- 
lent crime and five potential predictor variables: unem- 
ployment, the number of males aged 15-25 years of West- 
ern background, the number of males aged 15-25 years 
of non- Western background, the number of divorces and 
deflated consumption. The pattern emerging from the 
ordered list of cointegrated models is that the number of 
males aged 15-25 years of non- Western background and 
deflated consumption are the key predictors of recorded 
violent crime. Based on an analysis of VEG models, a 
plausibility argument and the statistical significance of 
estimated parameters, we select a cointegrated model out 
of the ordered list. The selected model holds, in addition 
to the key predictors, the number of males aged 15-25 
years of Western background. 

With the cointegration check switched off, the gener- 
ator is used to find short-run models specified in first 
differences. The key predictors of the short-run models 




1980 1985 1990 1995 
t 



2000 2005 



FIG. 1: Realizations (black dots) and mean forecasts of coin- 
tegrated model II of Sec. IIVI (solid black lines) and short-run 
model I of Sec. |V] (solid gray lines). The dashed black (gray) 
lines constitute error bounds of two standard deviations above 
and below the mean forecasts of the cointegrated (short-run) 
model. In panel (a), the models are estimated based on re- 
alizations from 1978 up to 1995 and forecasted from 1996 up 
to 2006. In panel (b), the models are estimated based on re- 
alizations from 1978 up to 2000 and forecasted from 2001 up 
to 2006. 
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